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(57) Abstract 



A system for creation of an image display such as electronic postcard (600). The system interacts with a user to create and configure 
the display. The user provides the image data to the system and optionally specifies a message and addressee (21) for the image display. 
The system creates the display, comprising the mixture of image and texmal data (502), and sends a notification including identification of 
the display to a specified addressee (21), for instance, the recipient of the postcard (600), The addressee (21) can then request receipt of 
the display from the system via identification information sent by the system. 
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Electronic Image Processing System 

The present invention relates generally to image processing and manipulation and 
more specifically to a system for the creation of electronic postcards. 



S Background of the Invention 

Photographic images or pictures may be represented and stored as a sequence of 
digital information. For instance, a photograph may be placed into a sczmner connected to a 
computer system. The scanner is designed to convert images into digital infonnation. A 
typical scanner comprises a row of discrete light sensors that are stepped sequentially across 

10 the photograph. At each discrete step the intensity and/or color of the photograph is measured 
by each discrete sensor in the row. The values are read out of the sensors prior to moving the 
row to the next discrete step. The row of light sensors is thus moved step-by-step across the 
photograph until the entire image is scanned. The end result is an array of data values 
representing the photographic image, where each value is the measurement taken by the 

IS discrete sensor element for a particular row. The information collected may then be 
transferred to a computer for fiirther processing. This process of converting image 
information into discrete values representing individual picture elements or pixels is also 
known as scanning. 

In the past, the typical way to create an electronic image was through such a scanner 
20 connected to a computer. Thus, if an individual desired to have a digital electronic 
photograph the individual would typically use a conventional photographic camera to create 
a film image, have it processed onto photographic paper, and then scan the image into a 
computer with a scarmer. Recently, this process has changed with the advent of digital 
cameras - cameras that directly create a digital photograph that may be transferred directly 
25 into a computer. 

The creation of digital cameras has created an opportunity to utilize the imique aspects 
of a digital photograph. For instance, a digited photograph can be sent across a computer 
network and shared by others electronically. Li addition^ digital photographs allow fiirther 
image manipulation. 

30 Recent advances in technology have broadened the utility of digital photographs. The 

first advance is the penetration of powerfiil personal computers in the home envhonment. 
These new personal computers are capable of running complex processing applications. 
Today, a typical system includes a 32 bit processor, large memory array, high capacity mass 
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Storage device, high resolution color monitor and fast modem. The price for such a system 
is now within the budget of many households. 

The second advance is the development and acceptance of the world wide web 
(WWW, web or Internet) as a mode of exchanging electronic information. The web is a 
5 network of computer systems that allow the free interchange of information. Users at a home 
computer or clients connects via a modem to the web via an Internet Service Provider (ISP) 
which provides users local access to the web. Users seeking access to the web typically dial 
up and connect to an ISP, which acts as an intermediary and passes data between the web and 
the user. Also connected to the web are servers - computers capable of supplying information 

1 0 or services to users. Each individual computer connected to the web has a unique identifier 
so that information can be directed to the proper location. Information is passed between 
users on the web via pages displayed on a browser, 

ISPs also provide the home user the ability to send and receive electronic mail (email). 
Often an individual accessing the web will have an email address^ a unique identifier for a 

15 particular user that allows tfiat user to receive mail. The ISP will receive the email for the 
user and store it until the user dials into the ISP to actually retrieve the messages. 

These events have created a situation where an individual at home can download the 
images captured by their digital camem or scanner into their home computer, connect to the 
web by modem in their computer, and transmit their picture onto the web. Thus, the 

20 individual can send the image to a second person, at a remote location. 

As digital cameras become widely accepted, a greater need will arise for flexibility 
in the electronic distribution of images. Current methods for distribution include email where 
the digital photograph is converted to a textual representation, sent to the remote user who 
then converts the textual representation back into the digital photograph. Users may also 

25 distribute the digital photograph via predesigned web pages which allows any number of 
remote users to examine the digital photograph. None of the current mechanisms allow the 
user to transfer a digital photograph to a server, process the image data into a display and send 
a notification to one or more specific individuals to view the display. 
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Summary of the Invention 

Accordingly, it is a goal of the present invention to provide a system which can 
load a picture image onto a server and to provide notice to specific individuals. 

It is an alternate goal of the present invention to allow the creation of electronic 
5 postcard composed of the user's digital photograph. 

It is an alternate goal of the present invention to allow the creation of electronic 
postcard that mimics aspects of a conventional postcard. 

It is an alternate goal of the present invention to allow the creation of electronic 
postcard having a postmark or logo information. 
10 It is an alternate goal of the present invention to allow the creation of electronic 

postcard that includes the ability to merge text information with the digital photograph. 

Other objects will be obvious and will appear hereinafter. The invention 
comprises an article of manufacture as exemplified in the following summary and detailed 
description. 

1 5 The present invention is a system and method for processing electronic image data. 

The system comprises at least one server computer connected to a network. The server is 
adapted to receive electronic image data firom a second computer connected to the 
network. The server processes the electronic image data and creates a display containing 
at least a portion of the processed electronic image data. One or more displays may be 

20 assigned a unique identifier. The data representing the display is in a format that allows 
for transmission to and viewing on a client computer. Viewing on the client computer is 
preferably accomplished via a web browser. The server is also adapted to send a 
notification containing the unique identifier to at least one person via the network. The 
person receiving the unique identifier can retrieve the one or more displays represented by 

25 the identifier firom the server for viewing. 

The processing on the server consists of one or more of the following: captioning, 
formatting, storing, transmitting, centering, cropping, flipping, anti-aliasing, scaling, 
compressing, filtering, color correcting, adding special borders and/or comer motife, 
blurring, and adding visual effects. In addition, the client may be augmented to perform a 

30 portion of the processing during interactions with the server. 

The data for the electronic image may also be provided via a photo processor 
where film is developed and then converted into an electronic image. The data 
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representing the electronic image may then be transferred from the photo processor to the 
client computer or directly to the server computer. 

The above mentioned objectives of the present invention will become more 
apparent and the invention itself better understood with reference to the following 
description of the embodiments of the present invention in conjunction with the 
accompanying drawings. 

Brief Description of the Drawings 

The foregoing discussion will be understood more readily from the following 
detailed description of the invention, when taken in conjunction with the accompanying 
drawings, in which: 

FIG. 1 is a simplified block diagram of coimections to the web; 

FIG. 2 is a simplified block diagram of a server and personal computer as found in 
FIG. 1 , illustrating a portion of the fimctions utilized by the present invention; 

FIG. 3 is a flowchart of the steps executed by a personal computer of the present 
invention in creating the front and back of an electronic postcard; 

FIG. 4 is an example screen of the present invention indication the static and 
generated image areas; 

FIG. 5 is a diagram illustrating the process of creating a generated image area and 
particularly the compositing of text on an image; 

FIG. 6 is an image of the present invention electronic postcard creation page, as 
displayed within a browser window, where the electronic postcard is empty of user 
information; 

FIG. 7 is an image of the present invention electronic postcard illustrating the 
prompt for a message; 

FIG. 8 is an image of the present invention electronic postcard illustrating the input 
of a message; 

FIG. 9 is an image of the present invention electronic postcard illustrating the 
prompt for input of an input image; 

FIG. 10 is an image of the present invention electronic postcard illustrating the 
selection of an input image; 

4 
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FIG. 1 1 is an image of the present invention electronic postcard illustrating the 
input image placed on a side of the postcard; 

FIG. 1 2 is an image of the present invention electronic postcard illustrating the 
prompt for an image caption; 
S FIG. 13 is an image of the present invention electronic postcard illustrating the 

composite created from the input image and image caption; 

FIG. 14 is an image of the present invention electronic postcard illustrating the 
prompt for the sender's mmie and address; 

FIG. 15 is an image of the present invention electronic postcard illustrating the 
1 0 prompt for the recipient's name and address; 

FIG. 16 is an image of the present invention electronic postcard illustrating the 
completed postcard prior to sending to the recipient; and 

FIG. 17 is an image of the present invention electronic postcard illustrating the 
display of a sent postcard. 

15 

Description of the Preferred Embodiments 

System Architecture 

The present invention relates to a system for the generation of electronic postcards for 
distribution via an electronic network- Fig. 1 illustrates a simplified view of a network of 

20 computers. Two basic machines are connected to the network, user (or client) computers 10 
and 20, and server systems 31 through 35. User computers, for example computer 10, are 
conceptually separate from server systems, as they provide the fimctions necessary for a 
typical user to connect to the network and exchange information with other user computers 
and server systems. In the present invention, the user computer 10 may interface to a variety 

25 of peripheral devices, including a scanner 12, printer 13, video camera 14 and digital camera 
15. In addition, the user computer 10 communicates via a communications device 11, here 
illustrated as a modem, for communicating over the network. 

The user computer 10 of the present invention is connected to a broader system of 
networked computers as illxistrated in Fig. 1. In this environment, user computer 10 connects 

30 via the modem 1 1 to an ISP 3 1 . The ISP provides the interface between the user computer 
and the web 30. The ISP 31 may also provide other services, such a receipt and storage of 
user email, storage of user files and various other services. As the interface to the web 30, 
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the ISP 31 receives packets of data fix>m the user computer 10 and stores the received 
information or forwards the information on the web 30 to the addressed destination. The 
addressed destination may be one of the servers 3 1 -35 or may be a separate user computer 20. 
One of ordinary skill in the art will appreciate the variety of configurations possible on such 
5 a network. While the web is illustrated as a single network, it is imderstood that it may 
comprise one of a nimiber of local area networks (LANs) and wide area networks (WANs). 

In the preferred embodiment, the electronic postcard fianctionality is implemented as 
a component of a web site. A web site is essentially a server computer providing public 
access to one or more files containing hypertext docimients. A user utilizing a web browser 
10 running on a client computer 10 to access the hypertext documents stored on one or more 
server computer 31-35 located on the network 30. The server, running hyper text transfer 
protocol (HTTP) web server software, transfers the hypertext document to the user computer 
for display on the browser. The present invention is directed to software that adapts the 
server to perform the fimctions necessary to create and transmit an electronic postcard. 

15 

Server 

With reference to Fig. 2, in the preferred embodiment a server 31 is a Pentium Pro 
(Intel Corporation, San Jose, CA) based computer connected to the Intemet running the Linux 
operating system (Red Hat Software, Inc., Research Triangle Park, NC) and the MetaHTML 

20 web server software 61 (Universal Access Inc., Santa Barbara, CA). The web server software 
supports the HTTP protocol - the standard used in World Wide Web interaction. When a 
request is made over the Intemet to view a web page, the server responds to this request 
returning a reply in the form of text describing the page in the hyper text markup language 
(HTML) format. A user specifies the page he would like to view with a Uniform Resource 

25 Locator (URL), or web address. 

Database on Server 

The server 3 1 is adapted to store and process data that is transmitted over the Intemet. 
Hie present invention utilizes two type of storage: temporary storage and permanent storage. 
30 The temporary storage keeps the data that is entered by the user during a "session" of 
interaction with the site. The temporary storage is called the Session Database 62. As the user 
makes changes to the postcard the data in the Session Database 62 is updated. 

6 
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In order to manage the data for a particular user, each user is assigned a unique 
identification number that distinguishes that user's session fi'om all others. This unique 
identification number is stored by the client via the web browser using a standard mechanism 
known as the "cookie mechanism." Hie identification number is used by the client as the key 
5 to the Session Database 62. While the cookie is stored on the client, writing of the cookie and 
recording and retrieving data firom the Session Database 62 is handled by the server via the 
MetaHTML software. 

The electronic postcard is composed of two data forms: textual and graphical. The 
textual data is stored in the Session Database while the card is being created. The graphical 

10 data (generated images and photographs) are stored in the file system of the server in a 
directory specifically created to store the temporary image files, herein designated as the 
Temp Image Database 65. In the preferred embodiment, the directoiy name utilizes the same 
cookie identification number although various other naming schemes are possible. By using 
the cookie in the directoiy name, the system ensures that each user has his own temporary 

15 directory. This directory can be thought of as an extension of the Session Database 62. The 
graphical data files are assigned names that are also stored in the Session Database. 

After the electronic postcard is sent, the postcard data is stored "permanently" in two 
other databases. One database, called the Card Database 63, stores the sender's and 
recipient's name and email address. The other database, called the Image Database 66, stores 

20 the images that have been constmcted for the firont and back of the card. In the preferred 
embodiment, after the electronic postcard is sent and the data is stored in the Image Database 
66, the temporary graphical data files and session data can be deleted. As an alternate 
embodiment, the temporary graphical data files may be retained for additional uses, such as 
creation of an albxmi of images. 

25 The data in both the Card Database 63 and the Image Database 66 is keyed by a 

unique identifier called the Card Key that is created at the time the card is sent. This key - 
the information required for retrieving the electronic postcard data firom the Card Database 
63 and Image Database 64 — is sent to the recipient of the card in a message. As a result, the 
recipient has sufficient information for interacting with the server so as to view the specific 

3 0 electronic postcard identified by the Card Key. 

The Card Database 63 also stores the date that the card was sent and the number of 
times that the card has been viewed. The data for a card is typically stored for 14 days (the 
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number of days is a number set when the system is configured, and is not a limitation of the 
server storage time). After that point the permanent card and image data may be 
automatically deleted. The data is also deleted after the card has been viewed 1 5 times (this 
number is also set when the system is configured). One of ordinary skill in the art can 
appreciate the possible variations for determining when to delete the data. As an alternate 
embodiment, the permanent card and image data may be retained for additional uses, such as 
creation of an album of images. 

Like the Temp Lnage Database 65, the Image Database 66 uses the file system to store 
the image files. The files are stored in a directory whose name is derived from the Card Key. 
hi this case, there is a separate directory created for each card that is sent. 

Dynamically generated web pages 

The present invention is adapted to process text and graphic data to create an 
electronic postcard that is composed of custom generated HTML pages including generated 
images within the HTML pages. The system looks at the data it has stored from previous user 
inputs and creates the HTML page to achieve the custom look desired by the user. The user 
specifies the look by supplying the graphical data to upload, the style parameters for the look 
of the card and text for the textual content and address. Certain style characteristics may be 
automatically detemiined from the user data. For example, different HTML text is generated 
when the photo is horizontally oriented than when it is vertically oriented. Orientation is, in 
tum, determined by the aspect ratio of the graphical data uploaded by the user. 

The electronic postcard 400, as illustrated in FIG. 4, is composed of HTML pages 
consisting of tables, with some cells of the table contaming static images and some cells 
containing generated images. Static unages 401 to 406 are created once and do not change 
during fiuther modifications to the postcard. Generated images 407 through 409 change 
during the customization of the postcard and are thus regenerated as required. The use of 
static and generated images improves the effiiciency of the system by preventing the recreation 
and retransmission of images that are essentially "fixed" during operation of the system. 

When a user enters text or makes a style selection, this input is sent to the server and 
is stored and processed using code residing on the server. This process uses a scripting 
language such as MetaHTML or Dynamo (Art Technology Group, Boston, MA) (detailed 
algorithms of this process are outlined below in the "Use" section). The server then sends to 
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the client a new HTML page containing the updated information and regenerated images. In 
order to improve operation of the system, only those sections of a displayed page are updated 
during an update of the information. Thus, only the images of the portion of the display that 
depend on the changed data will be regenerated and retransmitted. For example, referring to 
5 Fig. 4, generated portion 408 includes a caption and therefore portion 408 will be regenerated 
and retransmitted if the caption text data is modified. 

Client 

With reference to Fig. 1 , in the preferred embodiment the user or client computer 10 
10 is a personal computer that is connected to the Internet. The computer can be a Apple 
Macintosh (Apple Computer, Inc., Cupertino, CA), an IBM-compatible machine (IBM Corp., 
Armonk, NY) or any other computer capable of running a standard web browser. The client 
connects to and conamunicates on the web using the TCP/IP protocol. The actual physical 
connection is not critical for the present invention, and may be accomplished via a dedicated 
1 5 line or a modem via a diaiup connection. Turning to Fig. 2, in the preferred embodiment, the 
user computer 10 runs the Microsoft Windows 95 operating system (Microsoft Corporation, 
Redmond, WA) and a browser 5 1 such as Netscape Navigator (Netscape Communications 
Corporation, Mountain View, CA) or Microsoft Internet Explorer (Microsoft Corporation, 
Redmond, WA). The browser may be further augmented for supporting the Java language 
20 (Sun Microsystems, Inc., Moimtain View, CA) to enable the browser to support processing 
local to the client. 

The browser 5 1 is the application running under the operating system on the client 
computer that allows the user to make style selections, enters text and uploads photos. The 
browser 51 displays the pages received from the server 31 and collects user input for 
25 transmission to the server 3 1 . The pages in the preferred embodiment are written in standard 
HTML capable of being displayed on the web browser with no additional plug-ins or other 
applications. 

Graphic data uploaded by the user at the user computer 10 may be supplied from a 
variely of sources. For instance graphical data representing drawings created by programs 
30 such as Corel Draw (Corel Corporation, Ottawa, Ontario, Canada), Adobe Illustrator or 
Adobe Photoshop (both of Adobe Systems Incorporated, Seattle, WA) can be used as image 
data for uploading. For graphical data representing digital photos, various sources of data are 
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possible. As illustrated in Fig. 1, the user computer can receive data from a digital camera 
15, video camera 14, scanner 12, or from a film processor who provides electronic image 
data. In addition to the different sources, a variety of graphical data formats can be used to 
encode the image information. In the preferred embodiment, graphical data is provided in the 
5 JPEG or GIF format. 

In the preferred embodiment of the present invention, a separate client computer, such 
as user computer 21 of Fig. 1, may be the receiver of the electronic postcard. For reception 
of the electronic postcard, the receiving computer should have access to an email account and 
be able to send and read email using a standard email reader such as Eudora (QUALCOMM, 
1 0 Inc., San Diego, CA) or Netscape Navigator. 

Operation of the System 

As illustrated in Fig. 17, the electronic postcard has the familiar "look and feel" of a 
standard postcard, with a photo on one side and a personalized message and recipient's name 
15 on the other. The user fills in the electronic postcard with personalized information! 
recipient's name, message, signature; and uploads a photo selected by the user that will 
appear on the card. After the user has specified the information to appear on the electronic 
postcard, an email message is automatically sent to the recipient notifying them of the card. 

20 Connect the computer to the Internet 

The electronic postcard user must first connect their personal computer to the Internet 
usmg a modem and a telephone line. Using standard SLIP or PPP software the user instructs 
the modem to dial an Internet ^Service Provider. When the connection is made and all of the 
protocol hand shaking has completed, the user then connects to the server where they can 
25 create their electronic postcard. 

Go to a site that offers Electronic Postcard 

With an Internet connection the user can now use standard web browser software 
(such as Netscape Navigator or Microsoft Intemet Explorer) to access a site that offers the 
?0 electronic postcard service using the URL specific to this site. 
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The initial web page shows both sides of a blank postcard 

When the user first comes to the site the initial web page, as illustrated in Fig. 6, is a 
blank electronic postcard 600. The layout shows both the fi-ont 601 and the back 602 of the 
postcard 600 on one screen. The front 601 will hold the photo and a brief caption describing 
5 the photo. The back 602 will have the recipient's name, the message text and the sender's 
signature and optionally a postmark indicating the time and date of sending. Both sides 
initially do not contain personal content, but have backgrovmd graphics that resemble a classic 
blank postcard. 

10 Choose a tab to fill in part of the Electronic Postcard 

The user adds their personal infomiation to the electronic postcard by clicking the tabs 
603 through 607 that surround the front 601 and back 602 of the card 600. The tabs 603 
through 607 correspond to the different parts of the postcard that the user can fill in: sender's 
name and email address 606, recipient's name and email address 607, message to the recipient 
1 5 605, a user-selected photo 603, and a photo caption 604. When the user clicks a tab a new 
web page appears that contams a form with input fields for tiie selected part of the card. 
There is a different page for each tab. As an alternative embodiment other indicators could 
be used, for instance a sequential list of steps or a fixed sequence of steps could be 
implemented to complete the electronic postcard. 

20 

Specifying the parts of the Electronic postcard 

The user clicks one of the tabs 603 through 607 to bring up the page that corresponds 
to that part of the electronic postcard. The page will contain a form that prompts the user to 
enter the information that will appear on the card. The user fills in the fields in the HTML 

25 form and clicks the OK button to transmit the data to the server computer. The transmission 
is handled through a standard HTTP Form POST request. The server processes the fields from 
the POSTed data and validates the information. If the information is valid it is stored in a field 
in the session database. If the information is not valid the user is redirected to an error page 
which describes the problem. 

30 When the information in the session database changes, the server regenerates the 

postcard and the new information appears on the postcard. This process can also be used to 
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change a field that has abready been entered. The card is always displayed with all of the latest 
information in the correct locations. 

Fig. 7 illustrates the display after selecting the message tab 605. The electronic 
postcard generates a prompt 701 for the user to input a message for display on the back of the 
5 postcard 600. Fig. 8 illustrates the input of an example message in the prompt 70 1 . 

Fig. 9 illustrates the back of the card with the message rendered onto the postcard back 
image. The specific steps for creation of the rendered postcard back image is discussed 
below. Fig. 9 also illustrates the prompt 901 for a photograph after selecting the photo tab 
(603 of Fig. 6.) If the name of the file containing the photograph is known it may be entered, 
10 or the user may browse for the file 1 00 1 as illustrated in Fig. 1 0. 

Fig. 1 1 illustrates the electronic postcard after the photo has been uploaded to the 
server and processed by the server. The steps for processing ttie photograph are described in 
detail below. The fi-ont of the postcard 600 now has the photograph placed onto the fi-ont 60 1 . 
The firont of the electronic postcard may also include a caption by selecting the caption 
15 tab 604 of Fig. 6. The system then displays a prompt for the caption 1201 as seen in Fig. 12. 
The caption 1201 may be displayed in a variety of colors by selecting a color via buttons 
1202a, b, c, or d. In the example, the button for "white" has been selected. Fig. 13 illustrates 
the caption rendered onto the front 601 of the postcard 600. 

The final information needed for the postcard is the sender's and recipient's name and 
20 email address. Fig. 14 illustrates the electronic postcard system prompting for the sender's 
name after selecting the from tab (606 of Fig. 6.) The user specifies the name 1401a and the 
email address 1401b in the fields. The name is used for signing the postcard. The email 
address is used for facilitating fiirther conunxmications between the sender and the recipient. 
Fig. 15 illustrates the electronic postcard 600 with the senders name rendered onto the back 
25 602. 

Fig. 15 also illustrates the prompt for the recipient's name and email address after 
selection of the to tab (607 of Fig. 6.) The user specifies the name 1501a and the email 
address 1501b in the fields. The name is used for addressing the postcard. The email address 
is used for sending the Card Key to the recipient. Fig. 16 illustrates the electronic postcard 
30 600 with the recipients name rendered onto the back 602. At this point the electronic postcard 
is ready to be sent or the user may select any one of the tabs to correct or change the postcard. 
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Fig. 17 illustrates the card as sent to the recipient. The front 601 of the postcard 600 
contains the photograph and caption. The back 602 contain the message, name of sender and 
name of recipient, hi addition, a "stamp" 1701 and "postmark" 1702 have been added to the 
back 602. The postmark 1 702 contams the date and optional information such as location or 
S advertisement rendered onto the card. The stamp 1701 contains a logo that can be selected 
by the user or generated by the system. If generated by the system, it may contain 
advertisement material specified by the operator of the electronic postcard server. When the 
system sends the card, a notice 1 704 is given to the user that the postcard was sent. The user 
may then create another card by selecting one of the buttons 1 703a or 1 703b. 

10 

Generating the back of the postcard 

The back of the postcard, which contains the message, recipient's and sender's names, 
is generated by a sequence of steps illustrated in Fig. 3b: 

Generate postmark date string 304: After the card has been the sent the back 
15 of the card shows a postmarked stamp. The postmark shows the date that the 

card was sent and may include optional text. This information is stored in the 
Session Database when the user sends the card. It is formatted in a style 
appropriate for a postmark. 
Determine the orientation of the postcard 307: The front of the postcard can 
20 be displayed in two different orientations, depending upon the aspect ratio of 

the image uploaded by the user. If the photograph is taller than wide the 
postcard is shown with the card front displayed vertically. If the postcard is 
wider than tall than the front of the card is displayed horizontally. The 
orientation of the front impacts the back of the postcard in the preferred 
25 embodiment. 

Select background image 308: There are two different images used for the 
blank card back. In both images, the front of the postcard is shown slightly 
overlapping the back of the postcard. Through the use of shadows the front 
of the postcard is made to look like it is in front of the back of the postcard. 
30 The shadow that is cast on the back of the postcard is different for the two 

different orientations of the back of the postcard. In the upright portrait 
orientation as seen in Fig. 4, the overlap of the front onto the back is at the 
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low left edge of the back. In the landscape orientation, as illustrated in Fig. 
8, the overlap of the front onto the back is on the upper right edge of the 

back. I 

I 

Generate page description file 305: The layout of the text on the back of the 

I 

5 card is described using a page description language, such as Postscript. The 

page description is coded to size and position the text fields (the text 
specified by the user for the message operation 301, recipient's name and 
email address operation 302, sender's name and email address operation 303, 
and postmark operation 304). It also contains code to break the message text 

10 into lines (line-wrapping) so that it fits in the appropriate area of tlie card. All 

of the text on the back of the card is drawn in a handwriting-style typeface, 
but could be drawn in a different prespecified typeface or a typefaice selected 
by the user during operation of the system. | 
Render page description 306: The page description is converted to a gray scale 

1 5 image using a rasterizing engine such as the Ghostscript Postscript interpreter 

(Red Hat Software, Inc., Research Triangle Park, NC). The resiilt is called 
the text image. 

Composite text image and card back background 309: The text image is 
combined with the card background using a compositing routine. Fig. 5 
20 illustrates the process for compositing a message and sender's name onto the 

postcard back. An all black image is used as the overlay 501, the text image 
is used as the alpha mask 502, and the card background is used as the original 
503. The result is that: 

at any pixel that the text image 502 is black the overlay is passed through 

! 

25 and the resulting image 504 is the overlay 50 1 , in this example black. 

i 

at any pixel that the text image 502 is white the resulting image 504 is the 
same as the background image 503 at the corresponding pixel 
location. j 
30 at any pixel that the text image 502 is gray, the resulting image 504 is a 

i 

mixture of the overlay 501 (black) and the content of the background 
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image 503 at the corresponding pixel. The exact mix depends on the 
gray level of the text image pixel. 
Compress and convert the image 310: The resulting image is finally 
compressed and converted into an image format viewable in a web browser 
5 (such as GIF or JPEG format). The result of this process is an image that 

shows the generated portion of the back of the postcard with the user's text 
displayed in a handwriting style typeface. Fig. 17 illustrates a completed 
postcard back 602. 

10 Upload photo 

The photo tab is handled differently fi*om the other tabs. With reference now to 
Fig. 3a, in the photo file operation 351, the user specifies a file on the local client 
computer that holds the image data he or she wants to use on their card. The photo should 
be in JPEG or GIF format. The file name is specified using an HTML form with an 

1 5 INPUT field of type FILE. This field type is supported by Netscape Navigator browsers. 
The FORM data is POSTed to the server when the user clicks the OK button. The file 
contents are included with the form data and is received on the server. 

On browsers that do not support INPUT fields of type FILE, the photo is 
transferred as an email attachment. The email is sent to a special address (e.g. 

20 picturedrop.yobaby.com) on the server site that is used for transferring pictures. The 
name part of the address would encode the specific session that the photograph is 
associated v^th. A mail server running on that electronic postcard server treats mail to 
this address specially. For example in a mail server such as Sendmail this is be handled 
by a rule for a special host. The rule pipes the message to a program that decodes the 

25 session id out of the recipient name and decodes the message body. The program could 
be written in a scripting language like Perl and the message could be decoded using a 
Unix program such as MUNPACK. The program writes the decoded image file to the 
Temp Image Database directory associated with the session. 

30 Processing photo and generating postcard face 

When a photograph is received on the server the Electronic postcard server 
software processes the photo using several steps as illustrated in Fig. 3a: 
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Check size and type 354: The image data that is POSTed to the server must be 
in a size and fomiat that the electronic postcard software can handle. The 
first step is to check the byte coxmt of the data sent to the server. If the byte 
count exceeds some limit then the image is ignored and the user is redirected 
5 to an error page. Next the image data is saved as a temporary file and the 

type of the file is checked. The type is checking by examining the header 
bytes of the file which encode the file type. This is done use a program like 
the Unix command file. If the type is not one of the types supported by 
electronic postcard then the file is deleted and the user is redirected to an 
10 error page. 

Uncompress and convert format of photograph 355: The image data that is 
received fi-om the user is typically in a compressed format. It can be in one 
of several formats. To more easily manipulate the image the server first 
converts it into a imiform uncompressed format such as Portable PixMap File 
1 5 Format (PPM), The conversion can be done using standard translation tools 

such as are contained in the Unix NetPBM library (software distributed fi-om 
Washington University, St. Louis, MO as found in the directory specified by 
the URL http://wuarchive.wustLedu/graphics/graphics/packages/NetPBM). 
Scale the photograph 356: The fi-ont of the postcard is a fixed size and the 
20 image must be scaled to fit this size. There are two different versions of the 

fix)nt of the card; one for each orientation. If the photograph is wdder than tall 
then the horizontal (landscape) version is chosen. If the photograph is taller 
than wide then the vertical (portrait) version is chosen. Another problem is 
that the aspect ratio of the photograph may not exactly match the aspect ratio 
25 of the chosen card. The photograph is scaled so that one dimension exactly 

matches the desired size for the card and the other dimension is always larger 
than the card or exactly the same size. 
Crop the scaled photograph 357: If after scaling one dimension of the 
photograph is larger than the desired size for the card, the photograph must 
30 be cropped to fit onto the card. Since the aspect ratio of most pictures is 

similar (roughly 5x7) and the card is designed with approximately the same 
aspect ratio, the cropping is usually not significant. The cropping is done so 
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that excess is removed equally from both ends (top and bottom or left and 
right) and the picture ends up centered on the postcard. The cropping can be 
done use a standard graphics routine such as Unix command pnmcut. 
Generate page description file 358: The layout of the text input during the 
5 caption operation 352 is drawn on top of the photograph is described using 

a page desaiption language, such as Postscript. The page description is coded 
to size and position the caption text It also contains code to break the 
caption text into lines (line-wrapping) so that it fits in the appropriate area of 
the card. 

10 Render page description 359: The page description is converted to a gray scale 

image using a rasterizing engine such as the Ghostscript Postscript 
interpreter. The result is called the caption image. 
Select text color image 360: The user selects the color in the text color operation 
353 that they want to use for the caption text. Associated with each color is 
15 an image file that is filled with that color and is the size of the postcard front. 

Composite caption image, text color and cropped photograph 361: The 
caption image is combined with the scaled and cropped photogmph using a 
compositing routine. This operation is similar to the composite text image 
and card background operation 359 of Fig 3b and illustrated in Fig. 5 as 
20 discussed above. In this case, the gray scale caption image is used as the 

alpha mask, the text color image is used as the overlay and the photograph is 
used as the original. The result is that: 

at any pixel that the caption image is black the resulting image is the 
desired text color. 

25 at any pixel that the caption image is white the resulting image is the 

same as the photograph at the pixel location, 
at any pixel that the caption image is gray, the resulting image is a 
mixture of the text color and the content of the photograph at the 
corresponding pixel. The exact mix depends on the gray level of the 
30 caption image pixel. 

To make the caption text stand out more from the photograph, the caption text is 
dmwn with a contrasting "shadow". This is done via two compositing steps. 
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Each step works as described above. The first compositing step uses the 
shadow color (typically black) as the overlay, the caption image as the alpha 
mask, and the photograph as the original. The second compositing step uses 
the text color selected by the user as the overlay, the caption image as the 
alpha mask and the resuh of the first step as the original. The shadow is 
composited with a slight offset so that it appears below and to the right of the 
caption. 

Compress and convert the image 362: The resulting image is finally 
compressed and converted into an image format viewable in a web browser 
(such as GIF or JPEG). The resuh of this process is an image that shows 
generated portion of the back of the postcard with the user's text displayed 
in a handwriting style typeface. 

Sending the card 

When a photo, sender, recipient and message have been specified the card is 
complete and can be sent. When the user clicks on the "Send" button the server creates 
a card key, saves the card into the Permanent Database and sends an email message to 
the recipient. 

The contact information and the images are saved in the Permanent Database. 
The images for the front and back of the card are saved into the Image Database. The 
back of the card now includes a postmarked stamp. As already noted, the postmark is 
for the date the card was sent and the stamp can advertise the sponsor/host of the site. 
The sender's name, sender's email address, recipient's name and recipient's email 
address are saved into the Card Database. The date that the card was sent is also saved. 

The email message that is automatically sent to the recipient states that there is 
a card available on the web site for the recipient and that it can be viewed by opening the 
specified URL. The URL includes the Card Key that uniquely specifies that particular 
electronic postcard. 

30 
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Viewing the card 

The recipient may view the card as soon as they receive the email message with 
the URL. The recipient will use a web browser to enter the URL, and view their 
personalized page. 

5 

Variations 

While the preferred embodiment described above is directed to an electronic 
postcard, the system is not so lunited. The present invention may apply to a variety 
of systems that require the user to upload unage information for processing by the 

10 server into a display for viewing and to optionally provide a notice mechanism so as 
to alert an audience as to the availability of the created display. The present 
invention can be applied to create a variety of image processing systems, varying 
according to the degree of structure imposed on the system, the period of storage and 
the number of individuals to notify. For instance, the present invention can be 

15 modified to create: 

Photo Contest: In this embodiment of the system, the user can upload an 
electronic image onto the server where a minimal amount of stmcture is imposed 
(possibly including scaling and format conversion.) The image data may be stored 
only for a short time, as long as the contest is open. Once uploaded, the system 

20 would send a notice (including the image identifier) to the judge or judges notifying 
them of the entry of the new electronic image. 

Baby Journal: In this embodiment of the system, the user can upload an 
electronic image onto the server of a child or infant. The server may impose a fixed 
stmcture (i.e. a specific fi-ame and format for the page holding the image) or allow 

25 a variety of stmctures for the user to select firom. The image data could be retained 
for a long period, if not permanently. Once uploaded, the user can specify one or 
more recipients to receive notice of the new image, inviting them to visit and view 
the display. Thus, an album could be created for a child, holding a variety of images 
of the subject for a long period. 

?0 Family Album: In this embodiment of the system, the one or more related 

users can upload an electronic images. The server may impose a fixed structure (i.e. 
a specific frame and format for the page holding the image) or allow a variety of 
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Structures for the user to select from. The server may also segregate the electronic 
image displays according to each user (i.e. family member) while keeping a relation 
between all of the displays (overall fEimily album,) The image data could be retained 
for a long period, if not permanently. Once uploaded, the users can specify one or 
5 more recipients to receive notice of the new image, inviting them to visit and view 
the display. Thus, an album could be created for an entire family, holding a variety 
of nnages of the family in a structured album. The system may be further extended 
to allow visitors to comment on the photos, with the system storing the comments in 
a database for display with the images. 

10 In all of the above embodiments, the system can provide a variety of 

processing (e.g. captioning, formatting, storing, transmitting, centering, cropping, 
flipping, anti-aliasing, scaling, compressing, filtering, color correcting, addmg special 
border and/or comer motifs, blurring, adding visual effects etc.) The embodiments 
can further be adapted to provide additional processing by the client computer of the 

15 electronic image data and/or the display. For example, the system could be modified to 

allow the user to drag the client computer's mouse to re-center the picture on the fi*ont 
of the postcard. Software, running on the client, could update the display to show the 
re-positioned photograph. The display update could proceed while the mouse is being 
dragged, without communicating with the server computer. Software rurming on the 

20 client computer can also preview the result of the various other types of image data 
processing e.g. scaling, filtering, color correcting, compositing text, etc. The result 
produced as result of this processing on the client computer could be at the same 
resolution as created by the server computer or it could be a lower quality so as to 
minimize processing time for the preview, thus allowing the server to actually produce 

25 the final processed information. The client computer software can be implemented in the 
Java language so as to run within a Java enabled browser 

It should be understood that other embodiments could be created with 
variations in function, layout and look. Although the present invention has been 
described in detail with reference only to present preferred embodiments, it will be 

30 appreciated by one of ordinary skill in the art that various modifications can be made 
without departing from the invention. Accordingly, the invention is limited only by 
the following claims. 

20 

BNSDCX^ID: <WO ^9901B1BA1 J_> 



wo 99/01818 PCT/US98/13760 

What is claimed is: 



21 



RN.<5nnnj r> ^ wn ooni o i a a i 



wo 99/01818 



PCT/US98/13760 



CLAIMS 

1 . A method of sharing an image object located on a server comprising the steps of: 

receiving image data representing an electronic image; 
storing the received image data; 
5 associating an identifier with the stored image data; 

receiving an address for at least one recipient, the address specifying the location 
to send a message; 

generating a message including the identifier; and 
sending the message to the address for at least one recipient, 
1 0 whereby the at least one recipient can receive the message containing the identifier for 
the object. 

2. A method of creating an image object on a server comprising the steps of, at the 
server: 

1 5 receiving data representing an electronic image; 

storing the received electronic image data; 
manipulating the stored electronic image data; and 

generating an image object, the image object containing at least a portion of the 
manipulated stored electronic image data. 

20 

3. The method of claims 1 or 2 wherein the step of receiving the data representing an 
electronic image comprises uploading a file containing the data representing tiie 
electronic image fi-om a client computer. 

25 4. The method of claims 1 or 2 wherein the step of receiving the data representing an 
electronic image comprises receiving an email message containing the data representing 
the electronic image. 

5. The method of claims 1 or 2 wherein the step of receiving the data representing an 
30 electronic image comprises transferring a file containing the data representing the 
electronic image fi-om a second computer. 
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6. The method of claims 1 or 2 wherein the step of receiving the data representing an 
electronic image comprises transferring a file containing the data representing the 
electronic image via an electronic file transfer protocol. 

5 7. The mettiod of claim 2 wiierein the step of manipulating the stored image data further 
comprises at least one operation selected firom the set of operatiotis comprising: 
scaling, rotating, centering, mirroring, filtering, formatting, compressing, 
decompressing, color correcting, compositing, cropping, blurring, captioning, 
adding motifs, adding visual effects and combinations thereof. 

10 

8. A system for generation of a display including image comprising: 

a server computer having: 

at least one CPU, 
a storage device, 

15 an input inter&ce for receiving user information, and 

a conmiimications interface adapted for exchange of information 
between computers, 
the CPU adapted by a program to: 

input user information firom the input interface, the user information 
20 including electronic image data and destination data specifying at least one 

destination; 

store the user information in the storage device; 
process the electronic image data; 

generate the display including at least a portion of the processed 
25 electronic image data; 

associate an identifier with the display; 
create a message including the identifier; and 

send the message via the communications interface to the at least one 
destination specified by the destination data. 

30 

9. The system of claim 8 wherein the storage device further comprises long term storage 
and short term storage. 
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10. The system of claim 9 wherein the CPU is further adapted to store the display in the 
storage device and associate the identifier with the display stored in the storage device. 

11. The system of claim 8 wherein the input interface is a client computer connected to 
5 the server. 



12. The system of claim 11 wherein the client computer is connected via the 
communications interface. 



10 13. The system of claims 8 or 12 wherein the communications interface is a network 
adaptor for interfacing to a network. 

14. The system of claim 8 wherein the CPU is further adapted to process the electronic 
image data via at least one operation selected from the set of operations comprising: 

15 scaling, rotating, centering, miiroring, filtering, formatting, compressing, 

decompressing, color correcting, compositing, cropping, blurring, captioning, 
adding motifs, adding visual effects and combinations tiiereof. 

15. The system of claim 8 wherein the CPU is ftirther adapted to transmit the display 
20 associated with the identifier in response to a request including the identifier received via 

the communications interface. 
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